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IMPROVED METHOD OF PROCESSING DATA AND 
DATA PROCESSING APPARATUS 

This invention relates to improvements in methods of processing data, and 
5 especially (but not exclusively) to a method of extracting information 
from remotely sensed data. The invention also relates to data/image 
processing apparatus. 



Remote sensing is a field of activity with many applications. In a typical 
application, a sensor such as a microwave antenna on a satellite may be 
adapted to produce data from microwave signals emitted from the earth's 
surface or intermediate surfaces such as clouds or vegetation. Each data 
sample measured corresponds to the signal emitted from an area or 
footprint of the surface determined by the field of view of the sensor. As 
15 the satellite moves, data from different footprints are collected and can be 
processed to produce a data sample indicative of a spectral characteristic, 
such as brightness temperature, for a footprint, sets of data samples being 
used to generate a two-dimensional image of the surface. In one example, 
the image may correspond to the temperature of different parts of the 
sensed surface, such as land or sea which can be used for weather 
forecasting. Other applications include the measurement of wind speed at 
the ocean surface; precipitation; land and sea surface temperatures; ice 
and snow cover etc, etc. Obviously, the shape of the footprint will 
depend upon the satellite and sensor characteristics, shape of the surface 
25 and the location of each footprint on that surface. Similar considerations 
apply in the case of remote sensing by sensors mounted on other types of 
platforms, e.g. aircrafts, ships, and the ground. 



Typically, the sensed data sample corresponding to a footprint is 
individually processed and allocated to a data pixel. The pixel is selected 
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to be a location on the surface corresponding to the centre of the 
footprint. However, this approach is inefficient in its use of the 
information making up the data sample. 

5 In the case of apparent earth surface temperature measurements at 
microwave frequencies, the footprint for each sensed data sample may be 
of more than 1000km 2 (say 30km x 30 km). At coastal regions, where a 
footprint crosses both land and sea, contamination of detected signals 
occurs resulting in erroneous or inaccurate data samples. This is due to 

10 geophysical differences between land and sea. Prior systems have relied 
upon masking out the region where erroneous values occur, but this 
results in a loss of information around the coastline. Hitherto this has 
either been accepted as an inevitable result of preventing the 
contamination from giving unreliable results in that area, or linear 

15 extrapolation between reliable data either side of the sensed coastal area 
has been proposed. This is due to geophysical differences between land 
and sea. Similar considerations apply to any discontinuities across the 
entire range of scales. In order to overcome these problems, current 
solutions are to design better sensors, or orbit the satellite lower, or both. 

20 

In accordance with a first aspect, the invention provides a method of 
extracting information from remotely sensed data comprising the steps of: 

acquiring a plurality of data samples from at least one sensor, each 
25 data sample corresponding to a respective footprint and said one or 

more sensors being adapted to sense a parameter of a surface and 
having a known gain function; 



13-01-99 12:41 456 1 368 R-767 Job-13B 

13/01 99 12:42 FAX 0121 BARKER- BRETTELL - UK PAT OFF ©006/07 2 
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processing (reprojecting) the data samples to produce a respective 
footprint corresponding to the area of the surface contributing to 
each data sample; 

5 selecting a set of n bounded areas for the surface being sensed and 

allocating a variable to the area defined by each boundary; 

defining a weighting a. for each data sample dependent upon the 
sensor gain function and the location of the footprint for the 
10 respective data sample relative to the bounded areas of the surface; 

constructing a set of at least n equations from said weighted data 
samples; 

15 and solving said equations to determine the values for the variables 

allocated to respective bounded areas. 

Preferably each data sample comprises a convolution of the sensor gain 
function with the signal from the footprint on the surface which is 
20 incident upon the sensor. The data samples may form a data stream which 
may be defined spatially, or temporally or both. 

Preferably, the equations comprise linear equations. This makes them 
easier to solve, perhaps using matrixes. 

25 

Looked at one way, each data sample in the stream may represent the net 
radiation measured by the sensor over its field of view, taking into 
account its varying sensitivity for different angles of incidence (its gain 
function). The area of surface contributing to the field of view is defined 
30 as the sensor footprint. 
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Examples of ink3 suitable for printing or coating the fabrics arc: 

inks based on a polyvinylidene chloride copolymer binder system and (3- 
aminopropyl) silanetriol coupling agent 



Ingredient/Ink reference 


V246 


V24S 


V251 


Urea (THumeetant^ 


l n 
1 u 




10 


Water 


1 9R 


zoo 


Z<S<5 


Ammonium nho^nhatp Hnff3*r 


zu 


20 


20 


Emulsifier WN (Dispersant) 


3 


3 


3 


Agitan218 (Defoamer) 


2 


2 


2 


Alcoprint PT21 (Thickening agent) 


8 


8 


8 


A>?-J X A U^CUULtv «JUU1 \^ i i 1 1 1 1 1 rrt .1 sit tt I 


o< 

ij 




25 


Polidene 33-048 (Binder) 


273 


163 


163 


/vixLuioruuni nyuTOXiae 


1 A 

1.4 


1.4 


1.4 










[20% in water] 


25 


25 


25 


Alcoprint PT21 (Thickening agent) 


3 


5 


3 


Metallised beads f"40 micron^ ti-MtprT 








with sodium silicate and Slimiest 








A- 1170 


500 


*TJU 




Non-metallised beads (40 micron) 








treated with sodium silicate and 








Silquesx A- 11 70 






50 


Total Weight of Ink (g) 


998.4 


1,000.4 


998.4 


Binder volume % 
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Bead volume % 
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The material may comprise a woven fabric having conspicuous warp and 
weft crowns, or it may comprise a knitted fabric having a conspicuous stitch structure. 
In either event, the "grain" of the fabric is preferably less than the resolution of a camera 
at the intended minimum camera - backdrop distance. 

The material may be printed or coated in solid colour for chroma-keying, 
or it may be printed in a pattern or design. The material may be printed in difference 
colours of retroreflective ink, or may be printed or coated in a single colour of 
retroreflective ink and over-printed with a pattern or design, as by transfer, e.g. heat 
transfer printing. 

Especially in studio situations where lighting gives rise to elevated 
temperatures and low relative humidity, creating an increased fire hazard, the material 
is made fire or flame retardant. To this end, the fabric may comprise a structural 
component that chars before it melts, and may be or contain, for example, cotton or other 
cellulosic fibres to which a fire retardant agent has been applied. The fabric may 
however comprise an inherently non-flam fibre. 

The ink may be non-burning once applied to the fabric, and the polymeric 
matrix may comprise polyvinylidene chloride or polyvinyl chloride, in an aqueous ink 
system, or a non-flam plastisol. 
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The variables may therefore correspond to attributes of the surface in an 
image (for example a substantially two-dimensional image) of a surface 
constructed from an array of data samples from different positions on the 
5 surface. 

Preferably, (n + m) or more linear equations are formulated where (n + 
m) is the number of data samples used and m is greater than or equal to 
zero (and integer). This will (generally) produce an over-specified 
10 system. 

Preferably, each variable allocated to a bounded area corresponds to the 
parameter to be sensed (e.g. surface temperature) and assumes that the 
variable is relatively constant (at least over the measurement period) 
15 within the boundary (or will be closer to the values for its bounded area 
than an adjacent bounded area, or other bounded areas). 

For example, the information extracted may comprise surface temperature 
measurements. In this case, the sensor may comprise a microwave or 
20 infrared sensor or antenna adapted to detect radiation emitted from or 
reflected off the surface. The variable will then be a temperature value. 
By solving the linear equations for all or part of the entire area set, the 
values can be calculated from the weighted data. 

25 By giving a weighting to each data sample, and using several data samples 
to generate a set of linear equations, it is possible to utilise more of the 
data to improve accuracy. In the past, in practice it has generally been 
assumed that the individual data samples will correspond to accurate 
measurements of the variable with respect to the sampling frequency. 



30 
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5 

More than one set of linear equations may be used. Each linear equation 
in a set may be allocated a weighting, with different weightings used for 
each set. 

5 Preferably the sensor is adapted to receive information radiated or 
reflected from a footprint on the surface to produce a data sample rather 
than a single point measurement. Tbe linear equations may then be 
calculated from data samples corresponding to a number of such footprints 
for different surface areas. A boresight may be provided at the sensor to 
10 limit the field of view of the sensor, optimising the footprint size. 

Preferably, the footprints for two or more of the data samples used to 
construct the set of linear equations overlap at least partially. The 
overlap may be (by area) 5% or 10%, or 50% or any other value which 
15 enables the equations to be solved. 

Two bounded areas may be chosen for the surface to be sensed. For 
example, these may define the boundaries of areas of land and ocean at a 
coastline. Of course, many more boundaries may be selected. In one 

20 envisaged application, the boundaries divide the surface into a grid, with 
each area in the grid being allocated a variable. Each area may be a 
square or other shape which can be identified. The area of each "square" 
of the grid may be smaller than the size of each footprint for the data 
samples. This enables an increased resolution to be obtained. For 

25 increasingly small grid areas, the amount of overlap between footprints 
may need to be increased to produce a computable set of equations. 

Preferably, each data sample used to construct the set of linear equations 
corresponds to a footprint covering a different but overlapping area of the 
30 surface. The sensor may therefore be moved relative to the surface and 
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take a series of snapshots of different areas over time. Alternatively, a 
set of snapshots may be taken during a single timespan. 

In one possible arrangement, nine data samples are used to construct nine 
linear equations, with the footprints for each data sample being arranged 
in a 3 row by 3 column grid. However, the optimal number of equations 
depends on the relationship between the sensor and the areas defined. 
Each footprint in the grid may partially overlap its adjacent footprint. 



In an alternate arrangement, enough data samples may be acquired to 
completely cover the surface with overlapping footprints. These data 
samples can then be used to provide a set of equations whereby the 
variables allocated to the bounded areas in the surface are all determined 
in one process. This is an alternate to using groups or sets of data 
15 samples to cover the surface in several sets. 

The sensor in one preferred arrangement may be adapted to produce a 
data sample for a footprint in the form: 

+— 

20 T a = jh(t)ffG(eU)+e,®(t)+<b)t 6 (X(Q,4>),Y(Q,$),t)cos<bdQdbdt 

where t is the time relative to the measurement time, h(t) is the impulse 
response of the sensor, (?(0,<|>) is the normalised gain function for the 
sensor in the direction (9,(|>) relative to the direction of the sensor at the 
25 measurement time, e(f),«I>(r) describe the movement of the sensor during 
the measurement period and (X(e^).V(Q.^)) is the projection of the 
viewing direction (8,<t>) onto the surface. 
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In the case of microwave sensing, T Q may be surface temperature 
brightness, although it could be any other parameter depending on the 
type of sensor used. It will aJso be appreciated that other parameters than 
land and sea temperature can be measured, such as snow field cover, 
ocean surface wind speed etc. 

Assuming that brightness temperalures vary slowly compared to the time 
scale of the measurement and reversing the order of integration: 



io t b =JjG(e,(t))7;u(e,<i)),r(9,4>))cos^erf«i. 

where G<e,<j>) = jh(t)G(e(t) +6,<E»(r) +ty)dt 



G(8,(j>) is the sensor gain function integrated over the measurement 
interval. 



The footprint associated with the true antenna response G(Q,fy) is known 
as the Instantaneous Field of View (1FOV). The footprint for the time 
integrated C?(e,<t>) is called the Effective Field of View (EFOV). The 
processing of the data samples to project the EFOV onto the surface of the 
20 Earth, for example, results in an elliptical footprint, with the shorter axis 
parallel to the scan. If the sampling distance at each frequency is shorter 
than the dimensions of these projected footprints they overlap. 



Each equation may be (for two variables) of the form: 
T 0 (x,y) = T a L(x.y) + T b (l-L(x,y)) 

where L(x,y) = 1 if (x,y) is a point within a first boundary 
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= 0 if (x,y) is a point within a second boundary 
T » = variable allocated to the first boundary 

Tb = variable allocated to the second boundary and x,y 

are co-ordinates representing a position on the 

surface. 

From nine data samples, T 0 (x,y), nine linear equations in terms of T„ and 
T b can be established and solved for T, and T b . 

5 Convolving the antenna gain function over the model yields; 

Z = J/ Q (6 -9) (X (6 , $),Y (Q , *)) T a + (1 - L (X (Q , Y (Q , *))) T b }cosijxfBri|> 

= <xT a + (l~a)T b 
where a. = \\G®,§)L{X{Q,§),Y <x>s§dQd$ 

10 

Finally, restructuring enables the system of equals to be expressed as: 
T -u = a <J T ° + (1 - a '.n T » i = U3; = 1,2,3 
15 The nine equations can be expressed in a compact form as: 

where a Li are the weights for each data sample. 



20 



By overlaying the footprint for the centra] data sample of the grid of 3x3 
samples onto the map, the values of T a and T b derived (or other variables 
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as appropriate) can be allocated to each boundary area within that 
footprint. 

After evaluating the parameter for the central footprint, the calculation 
5 can be repeated by forming values of T a and T b from a second set of 
footprints offset from the first set. This can be continued to build up a 
two-dimensional image of the parameters across the whole or a substantial 
part of the surface. 

10 Obviously, the method can be readily expanded to cope with more than 
two parameters, such as land, sea and ice for instance, e.g. T„, T b , T c . 

The boundaries may be defined by reprojectuig the data samples onto a 
map of the surface, such as a GIS data model. The reprojection may be 
15 adapted to take into account changes in the profile of the surface, which 
may otherwise distort the footprint for each data samples. 

The weights, cc, may be based on the convolution for the gain function of 
the receiver with the boundaries of the area surface sensed. The 
20 convolution may be approximated by a summation. 

The linear equations may be solved using linear regression. They may be 
solved using matrix mathematical techniques. 

25 The data samples may, for example, comprise brightness temperature 
values, but may correspond to other parameters. They may be produced 
by integrating the sensor output over time, or be an instantaneous value. 
By selecting overlapping data samples to form a set, and using a grid of 
smaller areas than the sensor resolution (footprint size), increases in 

I 

i 



13-09-99 12:41 0121 456 1368 P. 13 R-767 j 0 b-138 

13/01 99 12:44 FAX 0121 456 BARKER BRETTELL PAT OFF @] 013/072 



10 



• 10 

resolution can be obtained. A grid area for footprint area of V 8 or 
smaller could be used. 

In accordance with a second aspect, the invention provides a software 
program for implementing on a computer adapted to perform a method in 
accordance with the first aspect of the invention. Alternatively, the 
method may be embedded in a computer chip to perform the data 
extraction in hardware. It may be adapted to process the data in real 
time. 

According to a third aspect, the invention provides a method of processing 
an original set of signals to create a processed image comprising: 

taking a set of original signals derived from one or more image sensors, 
15 the signals being representative of an image to be image processed; 

having a spatial map upon which the original image signals are to be 
translated, the map having a plurality of mapping regions; 

20 having weighting coefficients for each original signal in the set of original 
signals corresponding to the weight to be given to each individual original 
signal associated with any particular mapping region, and 

creating processed image signals if or each mapping region, the processed 
25 image signals for individual mapping regions being determined by 
applying the weighting coefficients to the set of original signals for each 
individual mapping region so ; as to create a combined, weighted, 
processed signal associated with each mapping region. 



;i 

, ; 

i I 
i i 

ii 
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Preferably, there are at as least many original signals in a set as there are 
spatial mapping regions, and mojst preferably more original signals in a 

i 

set than mapping regions. . J 



Preferably, the weighting coefficients are associated with the directional 
sensitivity of the sensor(s) used to capture the set of original signals. 



Preferably, the processed signal for each mapping region is determined by 
assuming it to be a constant value and solving a redundant, or solvable, 
10 number of simultaneous equationsj which each have the processed signal as 
one parameter, and weighted valjies derived from the original signals as 
other parameters, the weighting and the original signals being known. 



Preferably, some or all mapping 
15 shapes. By knowing in advance 



regions represent known, predetermined 
what the "shapes" and/or sizes of the 
mappings should be it is possible to solve the equations for the initially 
unknown processed signal value for each mapping region from the 
measured original signals and the weighting coefficients to be applied - 
possibly using a best-fit technique] if there is no exact solution. 

;i 
■j 

The mapping regions may be stanjdard, possibly equal, areas (for example 
a grid). The mapping regions .may be irregular, with not all of them 
having the same areas, and/or outline shapes. Some or all of the mapping 
regions may be of precisely known areas/shapes representative of real 
25 physical features known to be prjesent in the scene being viewed by the 
image-gathering apparatus. For: lexample the mapping regions could be 
parts of a known coastline, or; known fields, or individual geographic 
features. . I 



i 

.1 
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Looked at in another way the invention can be thought of as a new 
technique for creating high resolution imagery from low resolution sensor 
sampling in both space and time. 

"Traditional" remote sensing consists of obtaining a set of sensor values. 
These are readings taken from a field of view seen, for example, by an 
observing satellite, and displaying these values as a grid of pixels on a 
computer display. The location of the centre of the field of view is 
computed from the satellite orbit and viewing geometry. This is then 
used to locate the appropriate display pixel. If more than one value is 
allocated to a pixel then some rule is used to select the "best" value. If 
the resulting image shows empty pixels then this is because not every field 
of view centre falls within every pixel, in this case some interpolation of 
adjacent data is required to supply missing pixel values. In order to 
minimise these effects the pixel image is scaled so that the pixel size 
approximates to size of the sensor field of view. In this way an image of 
the entire view scanned by the sensor is built up, its resolution being 
approximately determined by the satellite resolution. 

This traditional approach uses the pixel hardware in a directly linked 
sense to the data. It ignores the fact that the centre of the actual field of 
view is not necessarily at the centre of the pixel. It ignores the fact that 
the field of view is not described by the pixel geometry, the actual field of 
view is more likely to be an ellipse and may vary in size. It ignores 
overlap between sensor values or the relationship between them. These 
shortcomings of data processing are not normally significant when dealing 
with very high resolution data, say in the order of metres, but become 
much more of a problem if the sensor resolution is over kilometres. 
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The present approach is to look :at the entire imaging process and produce 

a more rigorous definition of remote sensing processing. Central to the 

idea is changing ground area boundaries from the prior art arbitrary pixel 

display to a properly geometrically defined set of geographic areas. The 

i 

5 geometric boundaries may constitute real boundaries such as coastlines or 
fields, or simply by arbitrary ; grids of rectangular areas of fixed or 
variable size. But in every case the boundaries must yield a fixed and 
consistent metric or coordinate system. The sensor ihen provides 
observed values over these boundaries either at the same time or at 
10 different times, with or without overlapping fields of view. We prefer 
overlapping fields of view - which is quite contrary to conventional 
thinking. 

If one assumes uniform values for each area within its boundary and over 
15 the time interval of the measurements being taken, then for each sensor 
measurement field of view these real responses are integrated according to 
the antenna response pattern. This gives sensor measurements as function 
of areal responses. Given all these related measurements it is then 
possible to solve for the whole geometric system to give the ground values 
20 for each defined area. 

i 

In the prior art, the main point is that remote sensing samples are 
projected "raw" onto pixel hardware without there being a proper 
mapping between them. We can remap the antenna pattern into land and 
25 sea areas (or other parameters) knd can map onto any co-ordinate system 
or geographical base. In other ; words the post sensor processing should 
remap the data onto a defined GIS or similar. Instead of computing, say, 
nine samples into two regions (as discussed in a later example) there is no 
reason why n samples should nbt be computed into n regions. A chip 
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could be loaded with the GIS and all samples pushed through it as a space 
time data stream with each sample positioned within the GIS. 

It will be appreciated that in prior art conventional Remote Sensing (e.g. 
using satellite data) established practice is to dislike irregular fields of 
view (FOV) (i.e. all fields of view from satellites are irregular owing to 
the satellite motion, scanning characteristics, the curvature of the earth 
and antenna gain functions), the solution being to crop down the data to 
give a central region of the FOV and say that that is the value for a pixel. 
Conventional thinking is to disregard, and even dislike, over-sampling 
(which is common, and becoming more so with modern sensing systems). 
In our view conventional thinking samples/fits RS data too soon to some 
standard co-ordinate framework - i.e. before it is weighted to compensate 
for contamination of signals by things from adjacent pixels (on the 
15 ground). The prior art fails to exploit the full set of available 
observations. 



10 



20 



We, on the other hand, believe that we achieve significantly better end- 
user oriented products from almost any digital data -base RS/GIS system, 
without awaiting "next-generation" sensors. 



In accordance with a fourth aspect, the invention provides a method of 
improving the resolution of an imaging system which generates original 
pixel signals corresponding to pixels of a pixel! ated detection field of 
25 view or attributable to pixels of a virtual pixellated detector field of view, 
the method comprising: 

taking the original signals and operating on them with a weighting 
function so as to generate processed signals for each mapping region of a 
30 predetermined map, the weighting function attributing a contributing 
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weight to each original pixel signal so as to determine a processed signal 
for each mapping region. 

Preferably the weighting function applies the antennas gain 
5 function/sensitivity function of the imaging system to the original pixel 
signals to at least partially determine the processed signal for each 
mapping region. 

Preferably the method comprises processing the original signals to obtain 
10 a plurality of values for at least some pixels of the original pixellated field 
of view (and possibly for all) . 

According to a fifth aspect, the invention provides an image processing 
apparatus comprising input signal receiving means; processed signal 

15 output means; and computational means; the computational means being 
adapted to take a set of original input signals from the input signal 
receiving means and of processing them by applying a weighting function 
which in use is used to generate an output signal for a predetermined 
mapping region, the mapping region being input to the computational 

20 means or stored there; the computational means being capable of applying 
respective appropriate weighting to the original input signals of a set of 
signals representative of an image to be processed to generate each 
respective output signal corresponding to each respective mapping region 
and of ourputting signals corresponding to the mapping regions to the 

25 processed signal output means. 

According to a sixth aspect, the invention provides an image processing 
system comprising image capturing means and image processing means; 
the image capturing means capturing or sensing an image signal for each 
30 pixel of a pixellated image field of view, and the image processing means 
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comprising image processing apparatus in accordance with the preceding 
aspect of the invention; the arrangement being such that in use the image 
capturing means obtaining an image of original signals for each of its 
pixels and the image processing means processing them to create output 
image processed signals translated into the mapping regions of the image 
processing apparatus. 

Preferably the system is capable of oversampling an observed scene to 
create a plurality of sensed original image signals for elements with the 
scene (possibly by having spatially overlapping original images, a 
plurality of which contain the elements, or by having temporarily 
overlapping original scene images, or both spatially and temporarily 
overlapping original scene, images), and of using the "redundant" data to 
improve the resolution of the system beyond the resolution of the image 
15 capturing means alone. 

The image capturing means may comprise a microwave antenna or an 
infrared receiver. This may be mounted on a remote sensing platform 
such as a satellite, aeroplane or ship. 



10 



20 



25 



In accordance with a seventh aspect, the invention provides a satellite 
system, or other remote sensing vehicle or installation having one or more 
sensors having an overlapping field of view so as to produce overlapping 
unprocessed images or data samples, and means for processing the images 
or data samples using a method in accordance with any one of the first, 
second, third or fourth aspects of the invention. 



30 



The system may comprise a plurality of sensors which sense infrared, 
microwave, visible or other radiation, such as a microwave antenna. 
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Looking at it one way, the invention lies in the use of overlapping image 
data from an imaging system to improve the resolution of the imaging 
system. By providing a satellite having a number of overlapping fields of 
view, and using the overlapping images in combination, better resolution 
5 can be allowed than using each image separately to derive information. 
This is achieved, in particular, by using a weighing function in 
combination with an accurate map of the size and/or shape of at least 
some, and preferably substantially all, features that should be being 
imaged to improve resolution. 

10 

The invention is especially applicable to the processing of images which 
exhibit areas with different spatial characteristics, and can result in more 
accurate knowledge of the value of the characteristics near a boundary. 
A map indicating where the boundary of the area is helps to compensate 
15 for erroneous effects due to boundary contamination. As one example, 
this may allow ships to be located in an area adjacent a coastline by 
producing accurate information in that area. Changes over time can be 
used to detect movement of a ship into or out of that area. 

20 Part of a particular embodiment of the invention relies upon the condition, 
or assumption, that within two bounded areas or mapping regions points 
in one mapping region have a measured value/signal (representative of a 
characteristic such as temperature) that is constant within the mapping 
region, or at least "constant" in the sense of being closer to other 

25 characteristic values (signals for other parts within the mapping region) 
than to points in the other bounded area or mapping region. 

There will now be described, by way of example only, one embodiment of 
the present invention with reference to the accompanying drawings of 
30 which: 



i 



13-01-99 12:41 0121 456 1358 P. 21 R-7S7 j ob -138 

15/01 ' 99 12:46 FAX 0121 456 13 BARKER BRETTELL PAT OFF Q 021/072 



10 



15 



20 



25 



18 



Figure 1 illustrates the configuration of the Special Sensor 
Microwave Imager (SSM/I) showing the scanning motion of the 
sensor; 

Figure 2 shows the arrangement of nine overlapping data footprints 
used to produce a set of linear equations; 

Figures 3, 4 and 5 show the three vertically polarised test images 
using the "raw" scan/back co-ordinate system; 

Figure 6 illustrates the land map of boundaries derived from UK 
admiralty charts; 

Figure 7 is a plot of geolocation error against relative position of 
boresight and boundary; 

Figure 8 is a plot of change of height against height itself on the 
same axis as Fig 7; 

Figures 9-11 illustrate a photographic view of the test scenes used; 

Figures 12-14 illustrate corresponding SSM/I images for figures 9- 
11; 

Figures 15-23 illustrate results of processing of test images; and 

Figure 24 is an overview of a method in accordance with one 
embodiment of the invention. 



t 
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A method in accordance with one embodiment is shown in schematic form 
in Figure 24. 

In a first step, a set of data samples are acquired to form a sample view or 
two dimensional image. The data samples may comprise various 
overlapping snapshots of parts of an area of a surface. These may be 
acquired by an antenna having a known gain function and a sensitivity to 
the parameter of interest. 



In a second step, a map or transformation of each snapshot on the surface 
is constructed by processing the effective field of view of the sensor in 
combination with a knowledge of the shape of the surface. This enables 
the actual footprint for each snapshot to be calculated using data about the 
15 surface profile. 

A set of, say n, data samples forming an overlapping grid are then 

selected, and each data sample is allocated a weight V a V„. 

The calculation of the weights is achieved from a combination of 

20 knowledge of the expected parameters of features of the surface being 
measured. For example, the surface is divided into bounded areas or 
mapping regions. Each area is assumed to be uniform and homogeneous 
and is allocated a variable p (corresponding to its spectral value). The 
weighting w for each data sample depends on the location of the footprint 

25 relative to these bounded areas. 

i 

The n data samples and the weightings V m are arranged in a matrix 

and, by suitable mathematics processing, the values of the unknown 
variables allocated .to each area are : determined. Returning to the map, 
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these calculated variables can then be used to form an image point or 
pixel at the centre of the n data samples. 

The process can then be repeated using blocks of adjacent data samples to 
build up values for adjacent image points or pixels in a similar manner 
(by calculating the allocated unknown variables from the new data) until a 
complete processed image of the whole surface has been constructed. 
Alternately, a set of footprints carry the whole surface of interest could be 
proceeded at once to substantially simultaneously produce pixel values. 

Of course, extracting the variables from the datasets depends upon the set 
of equations in terms of measured data and weightings being soluble. The 
method may therefore include further processing steps to test for 
computability and reliability of the processing. 

In one arrangement, the weightings are allocated to respective linear 
equations, one per data sample, according to the overlap between the 
footprint for the sample and the variables p allocated to each area. This 
also takes into account the sensor gain function, and can be readily 
achieved by conjugating the gain function with the surface area 
overlapping a footprint. 

One source of passive microwave data samples which can be used to 
measure surface, temperature is the special Sensor Microwave Images 
(SSM/I) on the United States Defence Meteorological Satellite program 
range of spacecraft. The instrument measures incident microwave 
radiation emitted or reflected by the earths surface with typical 3dB 
footprints of between 69 x 43 km . a „d 15 x 13 km, dependent upon 
frequency. 



30 
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With such large footprints, coastal zones must (using prior data extraction 
methodology) be eliminated from the areas for which many physical 
parameter would be retrieved to avoid problems due to contamination of 
footprints for coastal zone data samples (footprints covering both land and 
5 sea) . 

An important example of the problem of this coastal contamination occurs 
in the retrieval of surface wind speeds from the microwave data. 

10 The SSM/I instrument is constructed to continuously rotate, completing 
31.6 revolutions each minute. For approximately one third of each 
rotation (51.2 degrees to either side of the direction of spacecraft motion) 
the instrument measures the incoming radiation. The axis of the rotation 
is maintained to ensure a constant incidence angle between the direction of 

15 measurement and the surface normal vector at the point where the 
measurement direction intersects the Earth's surface. The combination of 
this conical scanning arrangement and the motion of the satellite results in 
data being collected on a succession of curved swaths across the Earth's 
surface each swath being 1400 km long (Figure 1). 

20 

The 85.5 GHz measurements are made every 4.22 milliseconds along the 
swath, resulting in 128 measurements spaced 12.5 km apart. The 
spacecraft itself moves 12.5 km forward during the 1.9 seconds required 
for one full rotation of the instrument. The high resolution 85.5 GHz 
25 data is sampled for every swath giving a 12.5 by 12.5 km resolution. The 
lower frequency channels are sampled every 8.44 milliseconds on 
alternate scans (designated A-scans), giving a sampled resolution of 25 km 
by 25 km. 
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The brightness temperature measured by the satellite in a given channel is 
affected by a number of factors: the instrument calibration; extraneous 
signals due to cross polarisation effects and radiation emanating from 
parts of the spacecraft and from outer space; and the signal from the 
target area entering the instrument at angles close to the direction of view 
(along the boresight). Calibration and extraneous signal effects may be 
removed using a standard pre-processing technique which results in a data 
sample comprising a "brightness ; temperature" measurement at the 
satellite which is supposed to represent as closely as possible the net 
radiation input for a narrow range : Q f angles about the boresight. This 
brightness temperature should be dqual the convolution of the antenna 
gain characteristics with the pattern of incoming radiation. A gain 
function which represents the responsiveness of the instrument to 
radiation entering at different angles to the boresight was experimentally 
15 determined pre-flight. 

A particular satellite brightness temperature measurement may be related 
to a pattern of microwave emission from the surface (and atmosphere) of 
the Earth by: ! 



4- ; 



where t is the time relative to the rjieasurement time, h(t) is the impulse 
25 response of the instrument, G(6(r)iJ the normalised gain function for the 
instrument in the direction relative to the direction of the boresight 

at the measurement time, Q (/),©(,) discribe the movement of the boresight 
during the measurement period and U(9,*) p y©,^)) is the projection of the 
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I 



viewiag direction (e,4>)onto the sJrface of the Earth. Assuming that 
brightness temperatures for any sensed area vary slowly compared to the 
time scale of the measurement and" reversing the order of integration: 

i 

'. i 

i 

5 T b = JjG©,^ (A- (9,<j)),y(9,c|>))cos<^%/(t. 

i ! 

_ -H- . ! 

where G{Q,$) - §h(t)G(Q(t) +6,0(f) + <|>)dr 

j 

where G(G,<t>)is the antenna response integrated over the measurement 
interval. Given the consistent : motion of the SSM/I instrument this 
10 function is assumed to be independent of the measurement time. 

I 

i 

The footprint associated with the true antenna response G(0.4>)is known as 

; | 

the Instantaneous Field of View' (IFOV). The footprint for the time 

i i 

integrated G(9,<j>)is called the Effective Field of View (EFOV). The 
15 projection of the EFOV onto the j surface of the Earth results in an 
elliptical footprint, with the shorter! axis parallel to the scan. Since the 
sampling distance at each frequency is shorter than the dimensions of 
these projected footprints they ov^rlip. This overlap blurs the microwave 
image and extends the coastal contamination problem. 

20 • I 

j I 

In the example described hereinafter, to obtain accurate date even at 

■ I 

coastal regions the antenna gain; function is convolved with a simple 
microwave emission model. Thej niodel uses GIS data to determine the 
land sea boundary and then assumes that all land areas within a small 
25 localised region have the same brightness temperature and that the sea 
within that region has an independent, but similarly uniform, brightness 
temperature. Convolving the antenna gain function with the model over 

i 

• ! 
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; 

the footprint associated with a given pixel results in a linear equation 
relating the brightness temperature .'measured at the satellite to the land 
and sea brightness temperatures assumed by the model. Repeating the 
convolution process for each of nine pixels forming a 3x3 square about a 



5 particular point as shown in Figure 



2 results in an over-specified system 



of linear equations relating two luiiknowns (the modelled land and sea 
brightness temperatures which are assumed to have the same respective 
values within each footprint) to j nine known values (the measured 

l 

brightness temperature for each pixel). These equations are solved using 
10 a least squares optimisation technique to obtain estimates for the actual 

! i 

land and sea brightness temperatures present within a combined footprint 

i 

of the nine pixels. . i 



15 



20 



As described hereinbefore, the ! time-integrated antenna pattern is 
convolved with a simple modei which employs only two brightness 
temperatures to describe the combined microwave emission from surface 

I j 

and atmosphere over land and sea areas respectively within the footprint 
of a particular measurement (i.e. onjy two mapping regions, each assumed 
to have a constant brightness temperature). The model is derived using 
GIS data to determine the coastal (position and may be mathematically 
expressed as: i i 



T b (x,y) = T land L(x.y) + T sea (1-L(it,y)) 



25 Where L(x,y) 



= 1 if (x,y) isia point on land 

= 0 if (x,y) is .a point in the ocean 



30 



T iand = tne brightnessj temperature of the land 
T see = the brightness, temperature of the ocean 
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Here land and sea brightness temperatures are assumed to include the 

i 

effects of the atmosphere intervening between a given point on the surface 
and the sensor. 



5 The brightness temperatures seen 



ay the satellite may be obtained by 



convolving the antenna gain function over the model substitution gives: 



10 



T b = JJ G(Q ,<p) {L (X (0,(f>),y"(9 , *)) +| (1 - L {X (8 Y(6,^)))T m }cos$dM$ 

! 

where a = ffG<B,i)L(X®4),Y®4))lpo&$d9d$ 



15 



20 



The above equation may be applied for each of the nine brightness 
temperature measurements corresponding to the 9 pixels surrounding the 
given point. Assuming uniform land and sea brightness temperatures 



within the 9 overlapping footprints, 
linear equations: 



this gives rise to a set of simultaneous 



T br .j = C^T,^ + (1-cti.P T,„i = 1,2,3 j = l,2,3 

With nine equations and only two unknowns (T land , T sea ), this system is 
clearly overspecified and will in general not have an exact solution. Some 
form of optimisation technique mustlbe used. Restructuring: 



25 



Tbi.j = CTi.j (T 



land 



T sca ) + T s 



shows that a linear regression of the brightness temperatures T b against 
the weights a will yield values for T, and -T sea and T SCB , which corresponds 
to the slope and intercept of the fitted line respectively. 
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i 

This retrieval results in average lane and sea brightness temperatures for a 
region consisting of the combined footprints from nine pixels 



approximately 87 by 78 km square 
GHz footprint) as opposed to 37 
measurements. (Although it should 



30 



(defined by the 3dB level for the 37 
by 28 km for the original pixel 
be noted that T b values are estimated 



for each pixel position on the original 37 GHz data grid (i.e. every 25 
km)). Thus resolution is sacrificed to gain the information needed to 
separate land and sea brightness temperatures. 

The accuracy of the retrievals wil be affected by the veracity of the 
assumption that the surface emission for an area covered by nine 
measurement footprints may be represented by only two uniform values 
for brightness temperature. Since this assumption is fundamental to this 



embodiment of the technique any 



resulting errors will represent an 



absolute bound on the accuracy of retrieval. These errors were partially 
constrained in this work by the use of cloud-free imagery of satellite 
frequencies which thus limited Ltmospheric, although not surface, 
variations. Other factors affecting ihe accuracy of the retrievals relate to 
the precision with which the relationship between surface emission 
patterns and temperature measurements at the satellite is modelled. 
Errors associated with these factors must be minimised if realistic land 
and sea brightness temperatures are to be retrieved. 

.1 

The method has been applied to 'three 37.0 GHz vertically polarised 
SSM/I images from the DMSP F13 satellite for the region around the 



southern end of the Red Sea and the 



Gulf of Aden (5-25N, 35-55E). This 



region was chosen because desert coastlines should present a less complex 
test case than would vegetated ones. 

The images were selected to meet the following criteria 
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The image had to be as cloud 



free as possible. This was necessary 
both to provide a simple and ambiguous test for the retrieval 
technique itself and to facilitate any geolocation correction. 



Coincident visible data from the Operational Linescan System 
(OLS; an instrument located on the same satellite) should be 



available. These daLa would 



be used to facilitate an investigation 



into possible OLS-SSM/I co-location and to provide additional 
higher resolution information about the studied scene. 



The OLS images were examined on the SPIDER (Space Physics 
Interactive Data Resource) World Wide Web site and once selected were 
ordered from the US National Geophysical Data Centre (NGDC), which 
15 made the data available by FTP. ! The corresponding SSM/I image data 
(see Table 2) were extracted from 'S mm tapes from the CRS archive and 
decoded using standard packages. This software generated "brightness 
temperature" images, computed from the actual satellite temperature 



20 



25 



measurements using a standard pre- 
Table 2: Test Images 


P 


rocessing technique. 


Date 


Julian Day 


Orbit 


Times 


23 March 1996 


83 


515354 


12:54-14:38 


24 March 1996 


84 ; 


516768 


12:42-14:26 


31 March 1996 


91 i 

i 


526667 


12:59-14:42 


i 





j' 

i 

I 

I 



13-01-89. 12:41 01 2 J 4gfiJ368 P. 31 ^ R-767 Job-136 

13/01 ^99 12:49 FAX 0121 456 BARKER BRETTELL .^Bc PAT OFF @ 031/072 



10 



15 



20 



25 



30 



:28 

I 

Figures 3, 4 and 5 show the three 37 GHz vertically polarised SSM/I test 

i 

images using the "raw" scan/track co-ordinate system. The coastal 
regions are delineated by white lines- 



i 



The coastline for the study area was digitised from UK Admiralty charts 
to an accuracy of the order of 1 km, this data being used to create a land 
sea mask of boundaries on a lat./lohg grid at a resolution of 0.02° (Figure 

6). ; 

j' 

i 
■ 

In the method of the present example of the invention, the precision with 
which the satellite field of view is 'projected onto the surface of the Earth 
is important, since the convolution operation is performed at a spatial 
scale of less than 1/8 of a pixel. . Unfortunately, the satellite ephemeris 
information in the SSM/I data is not supplied in a form readily applicable 
to this problem. The data do, however, include geolocation information 
for each pixel which may be i reversed through the satellite-Earth 
projection process to obtain some of the necessary parameters. The 
positional data do not display the required sub-pixel level of accuracy and 
must be improved through a manual or automatic re-registration of the 
microwave image before being employed. 

The sensitivity of the retrieval technique to geolocation errors may be 

investigated by convolving the j antenna gain function with models 

consisting of a straight boundary at different positions. As before, the 

convolution results in a weight, a, which indicates the relative 

contribution made on one side of the boundary. If one is trying to 

retrieve values for the other side jof the boundary, this weight may be 

regarded as the error due to contamination. For example, if a. is deemed 

to refer to the contribution of the land brightness temperaLure to the 

mixed pixel value,, that weight mky also be regarded as indicating the 

i 

■t 
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relative error which the presence of land introduces into the pixel 
brightness temperature if that value is viewed as an ocean brightness 
temperature. j 

i 

I 

5 The difference between the weights derived for two different, but closeJy 
spaced, boundary positions give an. indication of the error introduced into 
the modelling process by a faulty '■ geolocation. Figure 7 plots both the 

spatial derivative (the geolocation j error) against the relative position of 

i 

boresight and boundary. Figure ;8 plots the relative geolocation error 
10 (change in weight divided by the weight itself) against the same axis. 

i 
i 

In order for the retrieval technique; to actually improve anything, the error 
in modelling the antenna response j to the a GIS model must be less than 

the "contamination" error the technique is trying to remove. An 

j 

15 examination of Figures 7 and 8 leads to two important conclusions: 

i 

Geolocation ' errors of greater than about 2 km will lead to errors 
which comprise a significant, portion of the effect to be removed. 

i 

20 - For certain positions of the icoast with respect to the boresight the 

technique will be ineffective for any reasonable geolocation error 
since the effects of a displaced location far outweigh those of the 
combination error itself (see [Figure 8). 



25 Sea surface wind speeds and other! important geophysical parameters can 
be derived from polarisation differences. The effect of geolocation errors 
on these values may be determined Ithus: 
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T v -r M =aXM Mt +iX-ajT^ -aj^ - (l-a A )r ft> 

i 

=«v<^ -T kJand )+ (l-a v )(r v _ -T^) + fot w -a M )(T^-T hMQ ) 



Apfca 



Here the v and h refer to vertical and horizontal linear polarisations 
respectively. This equation reveals that polarisation differences vary 
across a coastline in a mariner very similar to brightness temperatures. 
The difference lies in the third terrp on the right hand side of the equation 
which represents the effects of any asymmetry between the vertical and 
horizontal instrument gain functions. Unfortunately there is known to be 
a discrepancy of several kilometres between the maxima of the vertical 
and horizontal gain functions (as projected onto the ground). Thus the 

third term, while still small, has some significance. 

i 

There is considerable error in the! locational accuracy of both OLS and 
15 SSM/I imagery as can be seen in j Figures 9-14. Figures 9, 10 and 11 
show the visible (OLS) view of each scene while figures 12, 13 and 14 
show the corresponding 37 GHz Vertically polarised SSM/I images. In 
these diagrams, the data are: shown on a (0.020 resolution) 
Latitude/Longitude- grid, with a digitised coastline overlaying the pixel 
data. The OLS data seem to be shifted to the West, whereas the SSM/I 
images are displaced to the North iyest. 



The strategy was carried out using, the SSM/I imagery for three 85 GHz 
images corresponding to the three: [test windows on different days (day 1, 
25 day 2, day 8). The resulting transformation coefficients were then applied 
to the original imagery and the results for first, second, and third order 
polynomials for the day 1, day 2<, and day 8 respectively are shown in 
Figures 15 through' 23. The illustrations are overlaid with the digitised 
coast outline to illustrate the accuracy of the fit. 
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order transform coefficients are given in Table 3. 



First , order transform coefficients for the three SSM/I 



Date 




x"! 


y" 


Julian 
Day 


Day 1 


const 


8.1049 


9.8219 


83 




X 


0.9883 


0.0107 


83 




y 


O.OS056 


0.9892 


83 


Day 2 


const 


2.5049 


8.4483 


84 




X 


1.0090 


0.0018 


84 




y 


-0;0027 


0-9997 


84 


Day 8 


const 


10.P395 


10.3634 


91 




X 


1.0015 


-0.0018 


91 




y 


-0:0049 


0.9991 


91 



From the constant term we can seej that the geolocational error caused by 
shift alone is of the order of 8 to 10 pixels (approx. 16-20 km) in both the 
x and y directions. With day 84 being the exception with a shift of only 

10 2.5 pixels in the x direction. TJpe errors of the fit of the GCPs (i.e. 

'■ 1 1 

coastline) to the polynomial are igiven in Table 4. For the 83 and 91 
images the improvement in fig ■ going from first to second order is 
considerable, whereas from second! to third is negligible. For day 84 the 
improvement from' first to second order is less effective, whereas the 
15 progression from second to third order is much more effective. 
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Root Mean Square Errors for the Ground Control Point fit to 

the Transformation Polynomial. 

i 

RMS Error 



Date 


Nura ■ 
GCPsi 


of Order 


X 

I 

.1 


y 


Total 


23 March 


•219 1 


1 


2.559 


3.035 


3.970 






2 


1.127 


1.374 


1.777 






3 


1.068 


1.051 


1.498 




214 \ 


1 


2.564 


2.087 


3.305 






2 


2.323 


1.374 


2.699 






3 


1.215 


1.017 


1.585 




347 


1 


2.069 


1.325 


2.458 




i 


2 


.1-460 


1.132 


1.850 




1 
i 


3 


1.419 


0.996 


1.733 



Following the geolocation techniques described above a further means of 

improving image geolocation may) be considered. In this method pixel 

locations are varied so as to optimise the goodness of fig criterion in the 

linear regression used to derive jthe sea. and land temperatures. The 

retrieval process rriay be completed at each location for a set of possible 

geolocation displacements. Definiijg: 

' i 
i 

rr- ' ! 
a (dX ,57) = J J G(Q 4)L (X (9 ,<j>) Y(B ,(j>) +6Y) cos^dBd^ 



for a possible geolpcation error (SjX, 6Y) and substituting into the abo 
equation yields: \ 

T b . =a ; A§X.bY).(Ti.-T ) + T 



ve 



20 



Restricting the possible displacements to points on a grid (i.e. 5X and 6Y 
are integer multiples of some srijall displacement) results in a set of 
overspecified linear systems. For example, if a 5 by 5 grid of 
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displacements is defined, 25 systems of nine equations each will result. 
The displacement which causes the retrieval to generate the smallest root 
mean square erro^ in the linear regression may now be assumed to 
correspond to the true location of the nine pixel set used for the particular 
retrieval. Being j associated with the correct location, the selected 
regression coefficients should yield the best possible values for the land 
and sea brightness temperatures. 

PRACTICAL IMPLEMENTATION OF THE METHOD 



The first tasks in! the implementation of the retrieval technique is to 
generate a set of weights a based on the convolution of the gain function 
with the land-sea scene. The gain function must be correctly projected 
onto the Earth's surface and so depends on the satellite-Earth geometry 
15 associated with eSch pixel. To accomplish this, detailed information 
concerning the movement of both the satellite and the direction of the 

l 

SSM/I sensor is required. There are a number of formats in which SSM/I 
data may be supplied. The F13 SSM/I data used for this study was 
originally provided by the US Fleet Numerical Meteorology and 
Oceanography Center (FNMOC). These data contain both ephemeris 
information for the satellite and a latitude/longitude location for each 
pixel. While the decoding software provided with the FNMOC data tapes 
does not extract satellite ephemeris information, communications with 
NGDC establish the necessary changes to the code. Unfortunately, the 
25 ephemeris data w^re not usable; the times for the satellite position 
measurements did j not coincide with the times for the corresponding 
temperature data, j 



30 



The only information within the FNMOC data set from which the 
movement of the satellite with time could be readily derived was the 
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location data for the pixel grid. Provisionally ignoring the movement of 
the satellite during! the course of a single scan, all pixels within that scan 
may be assumed .to be equidistant from the satellite location. This 
assumption allows! that location to be simply derived using spherical 
trigonometry. Giv^en the satellite location, the measurement direction for 
each pixel in thei scan may be calculated and the antenna footprint 
projected onto the; ground. Other parameters for the projection such as 
satellite altitude and incidence angle between the observation vector and 
the surface of the Earth must then be assumed to be close to their 
published mean values. This assumption is more reasonable for the 
incidence angle, which does not vary to a significant degree than it is for 
altitude; the altitude of the F13 satellite varies from 840 km to 875 km; 
the variation of incidence angle for F13 is not available, but for previous 
spacecraft this parameter has varied by less than 1.5°. 

j 

Given the need tb make such approximations, the projection of the 
boresight direction; for a measurement onto the ground does not exactly 
match the pixel location given in the data. The latter position (as 
corrected by any ! geolocation enhancements) is assumed to be more 
reliable, and the location of the centre of the projected footprint shifted 
accordingly. 

i 

With the project^ parameters in place, the footprint must be projected 
onto the ground. jAlthough projection software had been obtained from 
the University of j Bremen, this was restricted in its a Ppli cation and 
contained a numtfer of significant approximations. The projection 
function was thusj rederived from basic principles using plane and 
sphencaJ trigonometry and implemented as a subroutine for use by the 
retrieval programs.! 
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Once the correct : footprint projection function has been established, 
calculating the weights for each pixel is relatively straightforward. The 
time-integrated (Effective Field of View) antenna pattern is read in as an 
array of values on a 0.1° grid. The convolution is approximated by a 
summation, ■with each point in the pattern array being included in the 
summation if and only if that particular viewing direction intersects with a 
portion of the Earth's surface deemed to be land by the GIS mask. The 
net result of this process is an array of weights, and. each weight value 
corresponding to a single SSM/I 37 GHz pixel. 



If the optimal-fit geolocation improvement technique (described in Section 
6-3) is to be employed, the above process must be repeated once for each 
possible displacement between the given pixel location and its actual 
position. These displacements were taken from a 5 by 5 grid, consisting 
of possible displacements of -0.04°, -0.02°, 0, 0.02° or 0.04° in either 
ordinate (latitude or longitude), resulting in twenty-five possible values 
for a for each pixe'l. Correction using a much larger 21 by 21 anray with 
the same angular resolution of 0.02° between displacements was attempted 
in an effort to eliminate the necessity for the image-matching geolocation 
20 enhancement step, j 
: i 

The computation ojf weights is a relatively slow process. For a simple 
retrieval a 64 by 64 image took 50 minutes on one of the CRS Silicon 
Graphics Indy 2 workstations. The same image using the 5 by 5 array for 
each pixel needed ijor geolocation enhancement took 12 hours to compute, 
and, even with sorjie additional optimisation to the algorithm, the 21 by 
21 array took 48 hj>urs. In f uture it 5hou]d be possiMe tQ re$trucmre ^ 
retrieval algorithm jto achieve running times of one quarter to one third of 
this total, for example by extending the GIS mask to differentiate between 
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penally coa.stal jpi xel S and those which muS t be either 100% land or 
100% ocean.' | 

I 

Once ,he weightsjhave bean computed, they be combined with 

mCrOWI,e Kri8h 't S «»*"««» *•«. for the 9 pixel square surrounding 
pUel in , h e| lrea of inlerKt tQ form . atase( ^ a 

regression. If morje « hln one weight „ as ^ ^ ^ 

regression is perked for each possible disp.acemeW of the nine pixe ,s 
(which are assu^d to remain fixed with respec[ ^ 
coefftcients returned by me Iinear ^ ^ 

square, error ar used ,o ca.culate ,He land and sea brightness 
temperatures for t^e central P i*e.. The process is jcarried „ for each 
pixel ,„ the original grid spacing (25 km x 25 km) i 

: i i 

AS ts apparent to the skilled man. the method of thej present invention is 
Ppl.cab e to data faction in any applicatjon fa ^ ^ 

<or approximated or estimated, gain wiion is pr0 vided to 
P odnce an output ndmg „ , ^ _ ^ ^ 

operate m such a manner indude sonar hydrophones, .microwave antennas 
* meaaaS " K - P~*«» • convolved output d^ta sample. 

I i 

Envisaged Lppiioitions i„ clud e ,ra ffi ca b iH,y. si a ice monitoring 

urtT7;;°Tr vs smionary ,mage — j; 

use (each , f ,d perhaps defining a boundary), irrigation management 
ocean front variations, and coastal zone monitoring. j 

!lot a o;,;f 5aE t. ,hat m ° re abStraC ' *-'^-U fan within the 

observed by a sepsor. such as an image take, by J camera (e g digital 
or vdeo camera, a optica, sensing element. Possib e sensors ,!r u"T 
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the method may cover radar to sonar, from visible tb infrared or vertical 
sounding etc. Th e| important feature is knowledge (or approximation) of 
the sensor gain fuijction and use of this function to Extract more accurate 
data using a knowledge of "surface" boundaries. j 

In summary, the present invention provides, in one embodiment, a method 
of improving the extraction of data land/sea images "observed by satellite 
base sensors. ! 
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Given sensor values, VI to Vm, and areas Al 'to An, where each V 

» an integral of Al....An. and assuming each krea A i S precisely 
geometrically defined, and internally homogeneous!; assuming that the 
sensor spatial integration V is also precisely geometrically defined; and 
assuming that the entire geometric frame of reference is consistent, then 
providing m is greater than n we have a solubie system of linear 
equations. It may be that the problem naturally provides for the last 
constraint, but it Jan be ensured that m is greater than o r equal to n in 
three ways, , first j,y degrading in the spatial dimension- or second by 
degrading in the temporal dimension; or third, both together. 

I j 
* l > 

In the case of a coastal zone study it has been assume* that each dataset is 
a single time slicej and nine sensor values were taken, VI -9 to arrive at 

and a2, in this case laud and seaj values. If the time 
than the variability of the parameter being measured 
then it is possible that the V equations cou,d be derived from successive 
nme slices, rather than from the same time slice. i 



two unknowns, al 
interval were less 



Regarding the source of "additional information". we| would say first that 



the addition 
relationships 



of the geometric definitions of A 
with V provide the required data 



and their specified 
for more accurate 
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In one sense the information contained in V is 
obviously not increased, but the procedure provides i means of extracting 
the maximum amount of information from the original data. 



interpretation of V 

J 



It will be appreciated that in addition to being [applicable to image 
processing, and remote sensing (not necessarily | of an image), the 
invention is more generally applicable to signal processing and protection 
for such is envisaged. j 



13-01-99 12:41 
13/01 J.98 12:52 FAX 0121 




J 21 45G 1368 
1368 



10 



15 



BARKER BRETTELL 



R-767 Job-138 
UK PAT OFF @ 042/072 



1. 



39 

CLAIMS 



A method of extracting information from remotely sensed data 



comprising the steps of acquiring a plurality of data samples from at least 
one sensor, each dkta sample corresponding to a respective footprint and 
said one or more sensors being adapted to sense a parameter of a surface 
and having a known gain function, processing (reprojecting) the data 
samples to producJ a respective footprint corresponding to the area of the 
surface contributing to each data sample, selecting a set of n bounded 
areas for the surface being sensed and allocating a variable to the area 
defined by each boundary, defining a weighting a. for each data sample 
dependent upon the sensor gain function and the location of the footprint 
for the respective data sample relative to the bounded 1 areas of the surface, 
constructing a set of at least n equations from said weighted data samples, 
and solving said Equations to determine the values for the variables 
allocated to respective bounded areas. 



20 



25 



the footprint on the 



A method Jaccording to claim 1 in which each data sample 
comprises a convolution of the sensor gain function with the signal from 



surface which is incident upon the sensor. 



3. A method according to claim 1 or claim 2 in which the equations 
comprise linear equations. 

4. A method according to any preceding claim in which the variables 
correspond to poinjs in an image of a surface constructed from an array of 
data samples from different positions on the surface. 
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5. A method according to claim 4 in which (n + m ) or more linear 
equations are formulated where (n + m ) is the number of data samples 
used and m is greater than or equal to zero (and integer). 

6. A method according to any preceding claim in which each variable 
allocated to a bounded area corresponds to the parameter to be sensed 
(e.g. surface temperature). 

7- A method according to any preceding claim in which the variables 
comprise surface temperature measurements and the sensor comprises a 
microwave antenna! adapted to detect radiation emitted from or reflected 
off the surface. 



8. A method according to any preceding claim in which more thai, one 
set of linear equations is used and each linear equation in a set may be 
allocated a weighting, with different weightings used for each set. 

9. A method according to any preceding claim in which the sensor is 
adapted to receive information radiated or reflected from a footprint on 
the surface to produce a data sample and the linear equations may then be 
calculated from data samples corresponding to a number of such footprints 
for different surface areas. 



30 



size. 



10- A method according to claim 9 in which a boresight is provided at 
25 the sensor to limit h e field of view of the sensor, optimising the footprint 



11- A method according to claim 9 or 10 in which the footprints for 
two or more of the data samples used to construct the set of linear 
equations overlap at least partially. 
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12. A method according to claim 11 in which the overlap is (by area) 
5% to 10%, or 50% or any other value which enables the equations to be 
solved. 



13. A method according to any preceding claim in which two bounded 
areas are chosen 1 for the surface to be sensed. 

14. A method,' according to claim 11 in which the bounded areas define 
10 the boundaries of areas of land and ocean at a coastline. 

i 

15. A method according to claim 13 or 14 in which each area is a 
square or other shape which can be identified. 



16. A method 
area is smaller than 



17. 



accor 



ding to any preceding claim in which each bounded 
the size of each footprint for the data samples. 



A method a wording to any preceding claim in which each data 
sample used to ; construct the set of linear equations corresponds to a 
footprint covering a different but overlapping area of the surface. 

i 



18. 



A method according to any preceding claim in which nine data 
samples are used to construct nine linear equations, with the footprints for 
each data sample being arranged in a 3 row by 3 column grid. 

19. A method according to any one of claims 1 to 16 in which 
sufficient data S .am,Ie S are acquired to completely cover the surface with 
overlapping footprjnts, said data samples being used to provide a set of 
equations. 
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adapted to produce 
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'rding to any preceding claim whereby the sensor is 
a data sample' for a footprint in the form: 



10 



r a = /A(r)//G f e( ? )i8,*(r) +4) ) r4 ( X( e^) >F{e ^ )iOMS ^^ 

where t i S the timJ relative to the measurement time, h(t) is the impul,e 
response of the sensor, G(9,<|>) is the normalised gain function for the 
sensor in the direction reJative to the direction Qf Ae mor at ^ 

measurement time, e«.*« describe the movement of the sensor during 
the measurement period and <XO,^y {Q ^ )is the projection Qf ^ 
viewing direction (9,<j>) onto the surface. 

21. A method according to any preceding Cairn in which each equation 
is of the for- 1 - 



15 



T 0 (x,y) T a jL(x,y) 
where L(x.y) 



+ T b (l-L(x,y)) 
1 if (x,y) is a point within a first boundary 
0 if (x,y) is a point within a second boundary 
variable allocated to the first boundary 
variable allocated to the second boundary and x.y 
are co-ordinates representing a position on the 
surface. 



22. A method according to any preceding claim i„ which, after so.ving 
the equation, ,6 evaluate the parameter for the cent™, footprint, , he 



20 calculation is 



set and continued < 



repeated using a second set of footprints offset from the first 
o build up a two-dimensional image of the parameter, 



across the whole or a substantial part of the surface 
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23. A method according to any preceding claim in which the 
boundaries are defined by reprojecting the data samples onto a GIS map of 
the surface. 



24. A method according to any preceding claim in which the weights, 
a, are based jon the convolution for the gain function of the receiver with 
the boundaries of tlie area surface sensed. 

10 25. A method according to claim 24 in which the convolution is 
approximated by a summation. 

26. A method according to any preceding claim in which the equations 
comprise linear eqvations which are solved using linear regression. 

15 i 

27. A method according to any preceding claim in which the equations 
are solved using matrix mathematical techniques. 

28. A method According to any preceding claim in which the data 
20 samples are p'roduc id by integrating the sensor output over time. 

29. A method Jf extracting information from remotely sensed data 
substantially I as described herein with reference to the accompanying 
drawings . j 



25 



30. A software 



program for implementing on a computer adapted to 
perform a method in accordance with any one of claims 1 to 29. 

i 

31. A method df processing ; an original set of signals to create a 
30 processed image comprising: 
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taking a set of original signals derived from one or more image sensors, 
the signals being representative off an image to be image processed; 

5 having a spatial map upon which the original image signals are to be 
translated, the map. having a plurality of mapping regions; 

having weighting coefficients for each original signal in the set of original 
«gi»l. corresponding to the weight to be given to each individual original 
signal associated with any particular mapping region, and 

creating processed image signals for each mapping region, the processed 
-age signals for. individual mapping regions being determined by 
applying the weighting coefficients to the set of original signals for each 
individual mapping region so as to create a combined, weighted 
processed signal associated with each mapping region. 



10 



32. A method of processing according to claim 31 in which there are at 
least as many original signals ' in . set as there are ^ 

20 regions. 

33. A method of processing according to claim 31 or 32 in which there 
are more original signals in a set. than mapping regions. 

25 34. A method according to claim 31. 32 or 33 in which the weighting 
coefficient, are associated with the directional sensitivity of the sensor(s) 
used to capture the set of original signals. 

35. A method according to any one of claims 31 to 34 in which the 
processed signal for each mapping region is determined by assuming it to 
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be a constant value and solving a redundant, or solvable, number of 
simultaneous equations which lach have the processed signal as one 
parameter, and Righted values derived from the original signals as other 
parameters, the .Weighting and the original signals being known. 



30 



36. 



A method according to any one of claims 31 to 35 in which some 



or all mapping regions represent 



37. 



known, predetermined shapes. 



i 

A method according to any one of claims 31 to 36 in which the 
mapping region^ are standard areas (for example a grid). 

38. A method according to aly one of claims 31 to 36 in which the 
mapping regions are irregular, wjith not all of them having the same areas, 
and/or outline shapes. 

39. A method according to any one of claims 31 to 38 in which the 
mapping region^ are representative of real physical features known to be 
present in the sqene being viewed by the image-gathering apparatus. 

: 1 1 

40. A method of improving the resolution of an imaging system which 
generates original pixel signals corresponding to pixels of a pixellated 
detection field pf vi ew or attributable to pixels of a virtual pixellated 
detector field of! view, the method comprising: 

i 

taking the original signals and operating on them with a weighting 
function so as to generate processed signals for each mapping region of a 
predetermined map. the weighfing function attributing a contributing 
weight to each c?rig|inal pixel signal so as to determine a processed signal 
for each mapping region. 
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41. A method according to claim 40 in which the weighting function 
applies the antennas gain func[ion/ S ensitivity function of the imaging 
system to the original pixel signals to at least partially determine the 
processed signal for each mappirig region. 

42. A method according to claim 40 or 41 in which the method 
comprises processing the originil signals to obtain a plurality of values 
for at least some pixels of the original pixellated field of view. 

43. An image processing apparatus comprising input signal receiving 
means; processed signal output means; and computational means; the 
computational means being adapted to take a set of original input signals 
from the input signal receiving tieans and of processing them by applying 
a weighting function which in use is used to generate an output signal for 
a predetermined mapping region 1 , the mapping region being input to the 
computational means or stored there; the computational means being 
capable of a P p ly i ng respective appropriate weighting to the original input 
signals of a set of signals representative of .an image to be processed to 
generate each respective output signal corresponding to each respective 
mapping region and of outputting signals corresponding to the mapping 
regions to the processed signal output means. 



25 



44. An image processing system comprising image capturing means and 
image processing means; the image capturing means capturing or sensing 



an image signal for each pixel of 



a pixellated image field of view, and the 



image processing means comprising image processing apparatus in 
accordance with the proceeding aspect of the invention; the arrangement 
bemg such that in use the image capturing means obtaining an image of 



original signals for each of its 



pixels and the image processing means 



c 



c 



c 
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47 

processing them to create output image processed signals translated into 
the mapping regions of the image processing apparatus. 

i 

45. Apparatus according to claim 44 which is capable of oversampling 
an observed- scene to create a plurality of sensed original image signals for 
elements with the scene and of ijsing the "redundant" data to improve the 
resolution of the system beyond the resolution of the image capturing 



means alone. 



10 46. Apparatus according to c 



aim 44 or claim 45 in which the image 



capturing means comprises a microwave antenna or an infrared receiver. 

47. Apparatus according to claim 44, 45 or 46 in which the image 
capturing means is mounted on a remote sensing vehicle such as a 
15 satellite, aeroplane or ship. 



48. A satellite system, or othur remote sensing platform or installation 
having one or more sensors having an overlapping field of view so as to 
produce overlapping unprocessed images or data samples, and means for 
processing the images or data samples using a method in accordance with 
any one of claims 1 to 38. 



49. A satellite system according to claim 47 in which a plurality of 
sensors are provided which sense infrared, microwave, visible or other 
25 radiation, i 




Figure 1: The scanning geometry of the SSM/I instrument (from Hollinger et al. 
1987): 
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Figure 3: SSM/I 37 GHz Vertically 
Polarised Image for \ - 1 

The coastal zone is indicated. (Top left) 



^Figure 4: SSM/I 37 GHz Vertically 
Polarised Image for ^'c-j 2_ . 
The coastal zone is indicated. 
(Top right) 



Figure 5: SSM/I 37 GHz Vertically 
Polarised Image for Dtebj ^ 
The coastal zone is indica fed. "■ 
(Bouom left) 
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150 



Gedlocation error relative to the location of the coastal boundary with 
resp|ect to the boresight. 
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Figure 8: 



J L 



50 ! 100 

Position of Coast, km (Boresight = ?S) 



150 



Geblocation error as a fraction of coastal contamination error plotted 
against the relative location of the boundary with respect to the 
boresight. 
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Figure 9: OLS Image and Coastline Overlay for ^^^j ' 
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Figure 12: SSM/jl 85 GHz Vertically Polarised Image ajid Coastline Overlay for 1>^1 
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Flgwc 14: SSmK-85 GHz Vertically Polarised Image and Coastline Overlay forttx-, S" 



of!* 



***** 



THIS PAGE BLANK tusne» 



THIS PAGE BLANK iuspto) 



1 3-01-99 12:41 0121 456 1368 P. SB R-76T Jab-1 39 




33 



THIS PAGE BLANK (uspti,, 




Figure 20: SSM/I 85 GHz Image for cWj 3 : Georectified with a 
Order Polynomial. 
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